Recursive Smoothers for Hidden Discrete-time Markov Chains

نویسنده

  • LAKHDAR AGGOUN
چکیده

Hidden Markov chains have been the subject of extensive studies, see the books [1, 2] and the references therein. Of particular interest are the discret-time, finite-state hidden Markov models. In this paper, using the same techniques as in [3], we propose results that improve the finite-dimensional smoothers of functionals of a partially observed discrete-time Markov chain. The model itself extends models discussed in [2]. The proposed formulae for updating these quantities are recursive. Therefore, recalculation of all backward estimates is not required in the implementation of the EM algorithm. This paper is organized as follows. In Section 2, we introduce the model. In Section 3, a new probability measure under which all processes are independent is defined and a recursive filter for the state is derived. The main results of this paper are in Section 4 where recursive smoothers are derived.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Relative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain

 In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...

متن کامل

Time discretization of continuous-time filters and smoothers for HMM parameter estimation

In this paper we propose algorithms for parameter estimation of fast-sampled homogeneous Markov chains observed in white Gaussian noise. Our algorithms are obtained by the robust discretization of stochastic differential equations involved in the estimation of continuous-time Hidden Markov Models (HMM’s) via the EM algorithm. We present two algorithms: The first is based on the robust discretiz...

متن کامل

Taylor Expansion for the Entropy Rate of Hidden Markov Chains

We study the entropy rate of a hidden Markov process, defined by observing the output of a symmetric channel whose input is a first order Markov process. Although this definition is very simple, obtaining the exact amount of entropy rate in calculation is an open problem. We introduce some probability matrices based on Markov chain's and channel's parameters. Then, we try to obtain an estimate ...

متن کامل

Symbolic and Parametric Model Checking of Discrete-Time Markov Chains

We present a language-theoretic approach to symbolic model checking of PCTL over discrete-time Markov chains. The probability with which a path formula is satisfied is represented by a regular expression. A recursive evaluation of the regular expression yields an exact rational value when transition probabilities are rational, and rational functions when some probabilities are left unspecified ...

متن کامل

Bivariate Markov Processes and Their Estimation

A bivariate Markov process comprises a pair of random processes which are jointly Markov. One of the two processes in that pair is observable while the other plays the role of an underlying process. We are interested in three classes of bivariate Markov processes. In the first and major class of interest, the underlying and observable processes are continuous-time with finite alphabet; in the s...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2005